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CHAPTER  1 


Introduction 

Evaluation  of  the  performance  of  one's  peers,  subordinates,  and 
even  superiors  is  an  activity  in  which  everyone  engages.  The  compar- 
isons of  the  behavior  of  one  aquaintance  to  that  of  another,  the  assign- 
ment of  grades  to  students,  and  the  unspoken  assessment  o'  the  courtesy 
and  efficiency  of  a sales  clerk  all  fit  into  the  area  of  performance 
appraisal . 

In  most  situations,  these  performance  appraisals  have  at  least 
two  common  characteristics;  they  are  made  without  adequate  information 
and  will  have  no  direct,  immediate  effect  on  the  person  being  evaluated. 
However,  people  are  often  placed  in  a position  where  thei^  evaluation 
of  the  performance  of  another  will  have  a direct  and  immediate  impact. 

In  an  organizational  context,  promotions,  pay  raises,  even  the  individual' 
job  may  be  effected  by  a system  of  performance  evaluation. 

Perfo rmance  Evaluation : A Rati ng  Process 

In  an  increasing  number  of  formal  organizations,  perfcrmance  eval- 
uation systems  have  been  introduced  as  a systematic  means  cf  establishing 
the  value  of  the  individual  members  of  the  organization  to  the  accomplish- 
ment of  the  goals  of  thi  organization.  Of  462  compares  surveyed  by  the 
National  Industrial  Conference  Board  (1954),  67%  had  performiance  appraisal 
systems  in  operation.  The  reasons  given  for  the  use  of  parformance  eval- 
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uatlon  systems  vary,  bu.  can  generally  be  divided  into  two  major  cate- 
gories: "adninistrative  uses"  and  "self-improvement  uses". 

In  the  self-improvement  category,  the  emphasis  is  placed  on  helping 
the  employee  understand  his  strengths  and  weaknesses  relative  to  his 
position  in  the  company.  The  interpretation  of  the  performance  eval- 
uation reports  are  compared  to  the  level  of  performance  desired  and 
expected  from  the  employee  at  his  current  position  and  indicate  the  areas 
in  which  he  must  make  improvement  to  satisfy  the  requirements  of  the 
position.  The  evaluations  also  point  out  areas  of  strength  and  are 
used  in  the  promotion  and  placement  process  of  the  organization. 

Some  of  the  most  important  administrative  uses  of  performance  apprai- 
sal systems  are  identified  by  Tiffin  and  McCormick  (1965): 

1.  Promotion;  When  the  objective  of  a performance  evaluation  system 
is  to  establisn  who  is  best  suited  for  promotion,  the  ratings 

should  distinguish  between  the  performance  of  an  individual  on  ; 

his  present  joo  and  his  potential  for  performance  on  a higher  job 

level. 

2.  Other  personnel  actions;  This  area  includes  transfers,  layoffs,  , 

and  discharges.  In  some  cases,  the  action  taken  may  be  the  result 

of  performance  appraisal  on  the  present  job.  In  other  cases,  the 

action  may  be  che  result  of  conditions  over  whicn  the  organization 

had  no  control  and  the  performance  appraisal  provides  information  j 

on  the  best  people  to  retain  and  how  best  to  utilize  those  people. 

3.  Wage  and  salary  actninistration;  In  many  companies,  pay  raises 

are  tied  to  productivity  and  ability.  The  performance  evaluations 
is  often  used  as  a running  measure  of  the  productivity  of  the 
employees. 
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knowledge  of  the  job,  aid  constructive  suggestions.  Employee 
characteristics  usually  considered  are  leadership  (actual  or 
potential),  motivation,  attitude  (toward  the  job,  his  supervisors, 
and  the  organization),  and  how  well  the  employee  "fits  in". 


Some  Problems  in  Performance  Evaluation 

Beach  (1971)  sees  perfonmance  evaluation  as  " — a systematic 
evaluation  of  an  individual  with  respect  to  his  performance  on  the 
job  and  his  potential  for  development."  This  definition  implies  that 
the  individual  is  the  receiver  in  the  system  and  in  part  that  is  the 
case.  Promotion,  retention/seperation,  job  assignment,  and  pay  raise 
decisions  are  made  on  tie  basis  of  the  evaluation  assigned  to  each 
employee.  The  physical  distance  between  the  decision  makers  and  the 
individual  being  evaluated  make  the  evaluation  process  a significant 
link  in  the  organization's  communication  activity. 

The  organization  is  also  effected  by  the  performance  evaluation 
process.  By  the  use  of  performance  evaluation  systems,  managers  of  an 
organization  determine  vhc  is  to  be  promoted  to  a position  of  authority 

I and  responsibility.  Klores  (1966)  observed," — the  biases  of  (the) 

•t 

i raters  will,  in  large  part,  determine  the  philosophy  of  the  organization. 

f 

If  the  raters  are  subjective  in  their  evaluations,  their  biases  will 
be  seen  in  the  people  wno  fill  responsible  positions  in  the  organization. 

Bias  in  Performance  Evaluation  Systems 


That  rater  bias  exists  was  pointed  out  by  Thorndike  '1920). 

Research  has  shown  that  if  an  incividual  rates  another  high  on  one  specific 
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trait,  there  exists  a tendency  for  the  rater  to  rate  the  same  indi- 
vidual high  on  other  traits.  This  tendency  is  refered  to  as  the  "halo 
effect". 

Another  area  of  rater  bias  Is  the  "constant  error".  Some  raters 
tend  to  be  more  lenient  than  others,  some  more  stringent  :;han  others  in 
the  evaluation  process.  This  behavior  seems  to  be  tied  up  in  several 
dimensions  of  personali':y  and  experience. 

Bias  introduced  inso  the  rating  process  by  the  subjectivity  of 
the  rater  was  examined  at  the  Conference  on  Performance  Appraisal  and 
Review  (1958).  Some  of  the  findings  include  a tendency  for  ratings  to 
bunch  at  the  "good"  end  of  the  scale,  and  the  appearance  chat  the  rating 
process  supplied  more  information  about  the  rater  than  the  ratee.  The 
lack  of  discriminabi li ty  among  ratees  from  ratings  bunched  at  one  end 
of  the  scale  was  interpreted  as  reluctance  on  the  part  of  the  rater  to 
assign  "bad"  ratings  to  an  individual  for  fear  they  might  do  serious  harm 
to  the  individual's  career.  It  was  also  suggested  that  the  raters  felt 
that  their  superiors  might  evaluate  them  on  the -basis  of  the  ratings  they 
gave  to  their  subordinates. 

Review  of  Previous  Research 

Performance  evaluation  systems,  if  they  are  not  used  carefully,  can 
be  detrimental  to  the  organization.  Studies  of  appraisal  systems  (French, 
Kay,  and  Meyers,  1966)show  that  evaluation  by  a superior  can  be  seen  as  a 
threat  by  the  person  be-^ng  evaluated.  The  more  frequent  the  evaluation, 
the  more  the  person  being  evaluated  may  perceive  the  process  as  being 
threatening.  Evaluateeu  with  low  self  esteem  tend  to  perform  at  a less 
satisfactory  level  when  they  are  evaluated  frequently. 
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Much  of  the  threat  perceived  by  the  person  being  evaluated 


stems  from  the  fact  tha'i  the  evaluator's  perception  of  the  require- 
ments of  the  job  in  question  may  be  entirely  different  from  the  job 
design  or  the  way  the  employee  percieves  the  job  (Barrett,  1968). 

The  perception  the  evaluator  has  as  to  the  successful  completion  of 
the  job  lends  some  bias  to  the  evaluation  he  makes  of  the  employee. 

The  resultant  dissonance  between  the  evaluator  and  the  person  being 
evaluated  increases  the  probability  that  the  evaluation  process  will 
be  seen  as  threatening. 

To  minimize  the  perceived  threat  in  a performance  evaluation 
system,  the  process  must  be  made  as  objective  as  possible.  In  an 
examination  of  the  objectivity  of  supervisors'  evaluation  behavior, 
Thompson  (1970)  compared  the  ratings  given  71  employees  by  a group  of 
psychologists  and  trained,  professional  managers  to  the  ratings  given 
the  same  employees  by  first  line  supervisors  over  a period  of  from  six 
months  to  two  years.  Tne  results  of  the  comparisons  showad  no 
significant  correlation  between  the  two  sets  of  ratings  Thompson  int- 
erpreted this  as  the  first  line  supervisors'  inability  to  discriminate 
on  the  performance  dimensions  selected  by  the  psychologists  and  managers. 
The  supervisors  did,  however,  make  some  sort  of  discrimination  and  rate 
the  employees.  Since  the  ratings  given  by  the  supervisors  did  not 
conform  to  the  expected  ratings,  there  must  have  been  som.e  bias  introduced 
into  the  system.  The  source  of  this  bias  should  come  from  the  rating  form 
used  or  the  subjectivity  of  the  raters. 

In  a study  of  rating  forms  and  their  formats,  Blumberg  (1966)  had 
subjects  rate  well  knov.n  names  on  a variety  of  traits,  using  a nine-point 
scale.  His  findings  showed  no  appreciable  difference  in  ratings  when 
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different  formats  were  jsed.  A variety  of  formats  were  used,  in- 
cluding : 

1.  The  good  end  of  the  scale  was  alternately  presented  at  the 
left,  right,  top,  and  bottom  of  the  response  scale. 

2.  Graphic  scales  were  used  as  well  as  numerical  scales. 

3.  Ratings  were  made  one  name  at  a time,  one  trait  at  a time, 
or  in  a matrix  with  free  choice  of  rating  order. 

Contrary  to  rating  scale  lore,  individual  rating  behavior  did  not 
appear  to  be  a function  of  rating  form  design. 

There  is  evidence  that  sociometric  preference  or  friendship 
choice  is  a function  of  the  degree  of  similarity  between  two  individuals 
in  such  characteristics  as  sex,  age,  race,  religion,  and  intelligence 
(Goodnow  and  Taguiri,  1952;  Mann,  1958;  and  Richardson,  1939).  It  might 
be  assumed  that  in  a suoeri or/subordinate  relationship,  friendship  based 
on  similarities  in  demographic  characteristics  may  results  in  a positive 
bias  of  the  ratings  assigned  by  the  rater. 

Quinn  (1969)  suggested  that  a possible  source  of  bias  in  the  rating 
process  might  be  examined  by  looking  at  the  relationship  of  demographic 
characteristics  between  raters  and  ratees.  Data  on  31,500  male  U.S. 

Air  Force  Captains  was  compared  to  the  same  data  on  their  raters  and  there 
was  found  to  be  no  significant  positive  bias  when  the  demographic 
characteristics  were  similar.  Quinn  also  suggested  that  '•ating  bias 
might  be  a function  of  similarities  in  the  psychological  make-up  of  the 
raters  and  the  ratees.  His  study  did  not,  however,  test  this  hypothesis. 
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Purpose  of  Study 


Operational  Defini tions 

For  the  purpose  of  this  study,  several  terms  must  be  defined. 

"Rating  process"  refers  to  any  process  of  a.*signing  an  evaluation  to 
the  performance  of  any  other  individual's  job  related  activities 
in  a formal  context.  T:iis  definition  includes  such  terms  as  "perf- 
ormance appraisal",  and  "job  evaluation". 

The  "rater"  referred  to  in  this  study  is  defined  as  the  person 
making  the  evaluation  of  another's  job  related  activities.  Synonomous 
terms  under  this  description  include  "foreman",  "crew  chief", 

"supervisor"  and  "manager". 

"Ratees"  are  defined  as  the  individuals  who  are  the  receivers  in  the 
rating  process.  Under  normal  circimstances,  the  ratee  is  the  subordinate 
of  the  rater. 

The  "experienced  rater"-"non-experienced  rater"  dychotomy  is  used  to 
distinguish  between  subjects  who  are  currently  in  a formal  position  that 
requires  them  to  rate  others  (experienced  raters)  from  those  subjects  who 
are  not  currently  in  a position  that  requires  them  to  perform  ratings, 
(non-experienced  raters).  There  was  no  allowance  made  for  subjects  who 
had  previous  rating  experience  but  were  not  currently  in  a rating  capacity. 

"Bias",  in  this  study,  refers  to  any  criteria  used  by  a rater  to  assign 
a rating  to  a ratee  other  than  that  criteria  specified  by  the  rating  form. 
Bias  has  been  referred  to  in  prev'ious  studies  as  "rater  subjectivity"  and 
"rating  error". 
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Hypotheses 

The  purpose  of  this  stuc(y  was  to  examine  the  rating  process  on 

two  dimensions.  The  first  examination  consisted  of  comparing  the  rating 

behavior  of  experienced  raters  to  the  rating  behavior  of  non-experienced 

raters.  It  was  felt  that  experience  in  assigning  ratings  to  others  may 

contribute  to  rating  bias.  If  this  is  the  case,  there  should  be  a 

significant  difference  between  the  rating  behavior  of  experienced  raters 

and  non-experienced  raters.  The  hypothesis  tested  was: 

There  is  a significant  difference  between  the  rating  behavior 
of  experienced  raters  and  the  rating  behavior  of  non-experienced 
raters. 

A second  area  examined  was  the  nature  of  the  difference  in  the 

rating  behavior  of  the  two  groups.  If  experience  in  assigning  ratings 

to  others  has  a "contaminating" effect  on  the  experienced  raters,  the 

bias  introduced  into  the  rating  process  should  be  more  strongly  associated 

with  the  rater  than  with  the  ratee.  A second  hypothesis  tested  was: 

Experienced  raters  introduce  more  bias  into  the  rating  process 
than  do  non-experienced  raters. 

The  relationship  between  the  raters  and  the  ratee  was  also  examined. 
Previous  studies  found  no  identifiable  bias  in  the  rating  process  as  a 
function  of  similarities  between  raters  and  ratees  on  demographic  character- 
istics. This  study  examines  rating  bias  as  a function  of  similarities 
between  raters  and  ratees  on  personality  and  superior/subordinate  role 
style  characteristics.  The  third  hypothesis  tested  was: 

Raters  will  bias  tneir  evaluation  in  favor  of  subordinates  wno  have 
personality  and/or  superior/subordinate  role  style  characteristics 
similar  to  those  characteristics  of  the  rater. 
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CHAPTER  II 
Methodology 

Subjects 

The  subjects  of  this  study  were  57  officers  and  enlisted  men  of  the 
United  States  Air  Force.  The  subjects  were  all  members  of  a single 
Squadron  within  a Wing.  There  was  representation  of  each  rank  within  the 
Squadron,  from  Airman  (E-2)  to  Lt.  Colonel  (0-5).  This  method  of 
subject  selection  allowed  for  some  representation  of  the  personnel 
structure  of  a basic  unit  within  the  Air  Force.  The  process  also  insured 
the  selection  of  both  experienced  raters  and  non-raters,  a condition 
crucial  to  the  testing  of  the  first  hypothesis. 

Method  of  Data  Collection 

Two  psychological  cests  were  administered  to  the  subjects  to  measure 
their  personality  characteristics  and  their  superior/subordinate  role  styles. 
The  two  instruments  selected  were  the  16  PF  and  the  R?M. 

Cattell's  16PF  (1970)  measures  sixteen  primary  and  seven  second  order 
personality  factors.  The  seven  second  order  factors  are  extroversion, 
anxiety,  poise,  independence,  neuroticism,  leadership,  and  creativity. 

There  were  two  criteria  for  selecting  the  personality  dimensions  to  be  usee 
in  this  study: 

1.  The  dimensions  selected  should  be  highly  visible  and  easily 
identified  by  a supervisor  in  the  course  of  his  normal 
activities. 
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2.  The  dimensions  selected  should  be  such  that  their  use  in 
performance  evaluation  would  result  In  "bias". 

The  leadership  factor  was  not  selected  because  it  was  felt  that 
leadership  constitutes  a valid  criteria  for  making  a performance  eval- 
uation. Creativity  was  omitted  as  a factor  in  this  study  because  it  is 
often  not  a visible  part  of  an  individual's  work  behavior.  Anxiety  was 
omitted  because  it  was  felt  that  pure  anxiety  is  not  highly  visible, 
or  that  it  is  not  easily  distinguished  from  neuroticism  when  it  is 
visible.  The  four  second  order  factors  from  the  ISPF  selected  for  this 
study  were: 

1.  Extroversion 

2.  Independence 

3.  Neuroticism 

4.  Poise 

Sweney's  Response  to  Power  Measure  (1972)  measures  six  superior/ 
subordinate  role  styles.  The  three  superior  role  styles  are  authoritarian, 
equalitarian,  and  permissive.  The  three  subordinate  role  styles  are 
rebel,  critic,  and  ingratiator.  All  six  superior/subordinate  role  styles 
were  used  in  this  study.  The  subordinate  role  style  of  the  ratee  would 
be  very  visible  to  a rater,  and  at  the  E-4  level  the  ratee  would  have 
had  opportunities  to  ha're  developeo  and  made  visible  a superior  role 
style. 

The  subje^'ts  were  then  asked  to  rate  ten  hypothetical  Airmen.  The 
"ratees"  (See  Appendix  A ) were  constructs  generated  from  written 
descriptions  of  the  four  personality  factors  and  the  six  superior/subordinate 
role  styles  measured  on  the  subjects.  Four  of  these  "rataes"  were  identified 
utilizing  the  adjectives  Cattell  uses  to  describe  the  four  factors  from  the 


12 


16  PF.  Table  1 shows  a list  of  these  descriptive  aajectives. 

TABLE  1 

DESCRIPTIVE  ADJECTIVES  FROM  SECOND  ORDER  FACTORS  OF  THE  16PF 


Extrovert! on 


Independent 


1. 

Venturesome 

1. 

Aggressive 

2. 

Socially  bold 

2. 

Stubborn 

3. 

Uninhibited 

3. 

Competeti ve 

4. 

Spontaneous 

4. 

Reservec 

5. 

Happy-go-lucky 

5. 

Critical 

6. 

Impulsively  lively 

6. 

Imaginative 

7. 

Gay 

7. 

Wrapped  in  •■nner  urgencies 

8. 

Enthusiastic 

8. 

Experimenting 

9. 

Assertive 

9. 

Free  thinking 

10. 

Stubborn 

10. 

Self  suffic'ent 

11. 

Participating 

11. 

Resourceful 

12. 

A joiner 

12. 

Disregards  rules 

Neuroti cism 


Poise 


1. 

Sober 

1. 

Self  reliano 

2. 

Prudent 

2. 

Realistic 

3. 

Taciturn 

3. 

No  Nonsense 

4. 

Serious 

4. 

Reserved 

5. 

Tense 

5. 

Critical 

6. 

Frustrated 

6. 

Faces  reali  :y 

7. 

Overwrought 

7. 

Stubborn 

8. 

Easily  upset 

8. 

Enthusiasti c 

9. 

Emotional 

9. 

Imaginative 

10. 

Sensitive 

10. 

Penetrating 

11. 

Cl inging 

11. 

Shrewd 

12. 

Apprehensive 

13. 

Worry! ng 

14. 

Humble 

15. 

T imid 

Adapted  from  Cattell , R.B.,  Handbook  ~cr  The 
16  Personality  Facto~^s,  (Champaigr,:  Irstitute 

for  Personality  and  Ability  Testing,  1S70) 


Toe  remaining  six  'ratees"  were  identified  by  ihc  us.p  of  five  very 
visible  charactaristi cs  adapted  from  the  six  superior/suo prcinate  role 
styles  from  Sweney's  RP'i.  Table  2 shows  the  characteristics  selected  as 
the  most  visible  and  thpir  ''esu'. n-ing  description  of  ec.cn  .p“  the  three 

superior  role  soylos. 


TABLE  2 


descript:on  of  superior  role  styles 


u.. 


Authoritarian 

Equal itari an 

Permissive 

Management 
Styl es 

Theory  "X" 

Autocratic 

Paternalistic 

Coercive 

Subjective 

Theory  "Y" 

Participative 

Rational 

Motivative 

Objective 

Missi onary 
Indulgent 
Seductive 
Subjective 

Communication 

Styles 

No-sayer 

Yes-seeker 

Objective 

Assessment 

Yes-sayer 

No-seeker 

Frustration 

Reaction 

Problem  seeker 
Extrapun itive 
Blames  others 

Solution  seeker 
Impunitive 
Frustration 
directed  toward 
situation,  not 
people 

Problem  seeker 
Intropunitive 
Blames  self 
and  system 

Assumptions 

about 

Subordinates 


People  are  bad, 
lazy,  stupid 
People  must  be 
forced  to  work 


People  arvi  in- 
telligen-: 
People  are 
motivated 
People  know 
their  joo  best 


People  are  weak 
People  need  love 
People  repay 
kindness  with 
work 


Adapted  from  Sweney,  A.B.,  Response^  tc  Power  Measure, 
A Test  of  Super-, or  and  Subordinate  Rp'.e  ?^-eferences , 
TWichita:  Test  Systems  Inc.,  1972,  op.  4 4 -'46") 


Table  3 shows  the  description  of  the  selected  cnaracteristics  of 
each  of  the  three  subordinate  role  styles. 
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TABLE  3 


DESCRIPTION  OF  SUBORDINATE  ROLE  STYLES 


lebel 

Critic 

Inqratiator 

Worker 

Styles 

Trouble  make*” 
lompl diner 
Protester 
Mutineer 

Idea  man 
Honestly 
critical 
Co-operator 

Organization  man 
Pleaser 
Yes-mar, 
Submissive 

Cotimuni  cation 
Styles 

io-sayer 

Yes-seeker 

Not  pre- 
programed 

Yes-sayer 

No-seeker 

Frustration 

Reaction 

Extrapunitive 
31ames  others 
Sadistic 

Impuniti  ve 
Seeks  solutions 

Intropuni ti ve 
Blames  self 
Masochist! c 

Assumptions 

about 

Superiors 

They  are  greedy 
They  are  unintelli- 
gent and  wrong 
They  cause  problems 

They  are 
reason aole 
They  wane  the 
truth 

They  reward 
workers  accond' 
ingly  to  real 
contribution 

They  are  threaten- 
ed and  must  be 
humored 

They  have  a right 
to  avoid  person- 
- al  blame 

Sociometric 

Behaviors 

Accepts  few  people 
Rejects  many 

Accepts  oeople 
moderately 
Rejects  oeople 
moderately 

Accepts  many  people 
Rejects  few  people 

Adaf  ted  from  Sweney,  A.B. , Resoorise  ^ower  Measure , 
A T(^  of  Superi or  ano  Subordinate  Ro'e  Preferences , 
TWithita:  Test  Systems  Inc.,  197Z\  pp.  44-46) 


Tne  rating  proces:  undertaken  Dy  tne  Suojects  of  zhc  .'lypotnetical' 
ratees  consisted  of  as;  igning  a numerica'i  evaluation  to  vscn  of  the  ten  ratees 


on  a scale  of  one  to  te  i (poor  to  excellent).  The  ratings  ^ere 
assigned  on  five  dimens.ons: 

1.  Leadership  potential 

2.  Ability  to  follow  orders 

3.  Ability  to  hold  respect  of  his  men 

4.  Communication  effectiveness 

5.  Attitude,  military  bearing 

The  subjects  were  isked  to  assume  that  there  existed  an  opening 
for  promotion  of  one  of  the  ten  ratees  from  the  enlisted  'ank  of  E-4 
to  E-5.  Only  one  of  th2  ten  ratees  could  be  promoted  at  this  time 
and  the  task  assigned  tie  subjects  was  to  get  their  "best'  man  promoted. 

The  ratees  were  to  be  assumed  as  equal  in  all  aspects  of  p'l^omotability 
(time  in  service,  time  in  present  rank,  qualifying  test  scores,  awards 
and  decorations,  etc.)  except  that  they  differed  in  terms  of  the  written 
description  provided.  The  description  was  to  be  treated  as  notes  taken 
by  the  subjects  from  observation  and  personal  interviews  with  the  ratees. 

On  the  basis  of  these  descriptions,  the  raters  were  to  assign  ratings. 

The  use  of  written  description  of  behavior  patterns  served  two  purposes. 
First  it  enabled  the  research  to  be  conducted  on  the  oehavior  of  the  subjects 
when  rating  "pure  types"  of  personalities  and  superior/suoordinate  role 
styles.  In  an  actual  situation,  no  one  person  is  all  extrovert  or  all 
neurotic,  nor  is  any  ora  person  totally  authoritarian  or  totally  ingrat- 
iator.  These  characteristics  can  be  measured  in  people  but  the  assessment 
of  the  personality  and/or  superior/subordinate  role  style  s made  on  the 
basis  of  dominant  char; cteristic  patterns.  In  this  study  "pure  types" 
were  used  to  reduce  amciguity  in  interpretation. 
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Also,  the  use  of  written  description  of  the  ratees  enaoled  the 
researcher  to  control  e.:traneous  variable  which  were  not  under  study 
in  this  research.  Such  possible  contributors  to  rating  bias  as  age, 
race,  and  physical  appearance  were  eliminated  from  the  study.  The 
subjects  were  placed  in  a position  of  being  required  to  make  their 
evaluations  on  the  basis  of  the  characteristics  being  studied. 

Statisti cal  Methods  Emp  oyed 

The  data  collected  Tended  itself  well  to  at  least  th-'ee  seperate 
methods  of  analysis.  Tj  test  the  hypothesis  that  there  is  a significant 
difference  in  the  rating  behavior  of  experienced  raters,  and  non-raters, 
a discriminat  analysis  vas  performed.  The  subjects  were  divided  into 
two  groups;  fifteen  exparienced  raters  and  forty-two  non-waters.  A 
second  discriminant  analysis  was  performed  to  examine  the  differences 
between  the  two  groups  on  the  measurements  of  their  personalities  and 
their  superior/subordinate  role  styles. 

Canonical  analysis  was  applied  to  the  data  collected.  The  data 
was  analysed  at  three  levels.  First,  an  analysis  was  performed  of  the 
relationship  of  the  personality  and  the  superior/subordinate  role  styles 
of  all  fifty-seven  subjects.  The  format  followed  at  this  level  was  to 
treat  the  measurements  of  the  subjects  on  the  two  instrumer.ts  as  the  pre- 
dictors and  the  subject's  behavior  in  the  rating  process  as  the  criteria. 

A second  canonical  analysis  was  appliec  by  dividing  the  subjects 
into  two  groups  (experienced  raters  and  non-rating  raters)  and  examining 
the  relationship  of  the  rating  behavior  ov  each  group  to  it's  respective 
measurement.  Again,  the  predictors  were  the  measurement  taken  of  each 
group,  and  the  criteric  consisted  of  the  rating  behavor  ov  the  group. 


17 


A third  series  of  .;anonical  analyses  were  appliec  to  tne  data. 
This  level  of  analysis  consisted  of  examining  the  four  possible 
combinations  and  superi ur/subordinate  role  styles  of  the  raters  and 
the  "ratees"  in  both  the  experienced  rater  group  and  the  non-rater 
group. 

Factor  analysis  was  applied  to  the  data  to  generate  constructs 
which  help  identify  rater  types  and  rating  behavior  types.  The 
experienced/non-experie iced  dychotomy  was  used  in  this  analysis, 
also.  Five  factors  were  generated  for  each  group. 
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CHAPTER  III 
RESULTS 


Discriminant  Analysis  of  Rating  Behavior 

For  the  purpose  of  this  part  of  the  study,  the  subjects  were  divided 
into  two  groups;  experiened  raters  and  non-experienced  raters.  The 
experienced  rater  group  consisted  of  15  subjects  and  the  non-experienced 
rater  group  consisted  o~  42  subjects. 

The  rating  behavior  examined  was  the  ratings  assigned  by  the 
members  of  each  group  to  the  hypothetical  constructs  described  in  the 
methodology  section.  Each  hypothetical  construct  was  rated  on  a scale 
of  1 to  10  on  five  dimensions.  The  range  of  possible  scores  that  could 
be  given  to  any  one  of  :he  constructs  was  from  a minimum  of  5 to  a maximum 
of  50.  Table  4 shows  tne  mean  and  standard  deviation  of  each  group  for 
each  of  the  hypothetical  "ratees". 

TABLE  4 

MEAH  AND  STANDARD  DEVIATION 
OF  RATING  BEHAVIOR 

MEAN  STANDARD  DEVIATION 


1. 

Authoritarian 

Experienced 

Rater 

12.666 

Non-experienced 

Rater 

15.733 

Experienced 

Rater 

6.580 

Non-Experien 

Rater 

7.372 

2. 

Equal itarian 

39.404 

41.799 

8.006 

8.072 

3. 

Permissive 

27.309 

28.799 

9.182 

8.735 

4. 

Rebel 

12.285 

15.333 

7.092 

10.230 

5. 

Critic 

34.714 

39.006 

7.065 

5.909 

6. 

Ingratiator 

30.880 

28.666 

7.945 

7.687 

7. 

Extrovert 

34.095 

34.466 

9.610 

8.943 

8. 

Independent 

25.214 

25.200 

9.513 

8.359 

9. 

Neurotic 

25.875 

23.133 

8.068 

7. 130 

10. 

Poise 

36.166 

33.399 

8.312 

6.905 

A discriminant  anilysis  was  performed  on  the  data  to  determine  if 
the  two  groups  were  significantly  different  in  their  rat' ng  behavior. 

An  F ratio  was  computed  in  a step-wise  process  to  test  the  significance 
of  the  function.  Each  variable  (ratee)  was  examined  by  adding  one 
variable  at  a time  to  :he  function.  Table  5 shows  the  analysis  including 
the  F ratio  and  the  te.;t  of  significance  at  the  .05  level. 


TABLE  5 

SIGNIFICANCE  OF  DISCRIMINABILITY  OF 
RATING  BEHAVIOR 


Step  # 

Variable 

Entered 

Resulting 
F Value 

Degrees 

of 

Freedom 

P'>obabi 

1 

5 Critic 

4.541 

1 

55 

< .05 

2 

9 Neurotic 

^-.177 

2 

54 

< .05 

3 

1 Authoritarian 

4.719 

3 

53 

< .05 

4 

8 Independent 

4.526 

4 

52 

< .05 

5 

6 Ingratiator 

4.031 

5 

51 

< .05 

6 

4 Rebel 

3.712 

6 

50 

< .05 

7 

3 Permissive 

3.494 

7 

49 

< .05 

8 

7 Extrovert 

3.016 

8 

48 

< .05 

9 

2 Equal itari an 

2.634 

9 

47 

< .05 

10  (F  level  for  eitry  of  variable  #10  (Poise)  was  insufficient 
for  further  computation). 

The  discriminant  analysis  shows  that  the  two  groups  are  distinctly 
different  in  their  rating  behavior.  Variables  number  5 arc  1 add  signi- 
ficantly to  the *discri ni nation.  (See  Appendix  B ) All  of  the  variables 
taken  together  result  in  a significant  difference  in  the  rating  behavior 
between  the  two  groups. 
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A discriminant  function  was  also  generated  from  cne  analysis.  This 
function  is  displayed  in  Table  6. 


TABLE  6 


DISTRIMINANT  FUNCTION  OF 
RATING  BEHAVIOR 


Vari able 

Function 

A 

Function 

B 

1 Authoritarian 

0.023 

0.145 

2 Equal itari an 

0.^-47 

0.433 

3 Permissive 

0.026 

0.112 

4 Rebel 

0.376 

0.466 

5 Cri  ti  c 

0.^46 

0.700 

6 Ingratiator 

0.174 

0.070 

7 Extrovert 

0.056 

0.077 

8 Independent 

-0.077 

-0.196 

9 Neurotic 

0.075 

-0.08' 

The  analysis  furthar  involves  the  classification  of  each  observation 
into  one  of  the  two  pra-selected  groups  (experienced  rater  or  non-experienced 
rater).  A two  by  two  matrix  was  generated  to  display  the  number  of  observations 
classified  into  each  g'oup.  This  matrix  is  shown  in  Taole  7. 


Pre-selected 

Groups 


Experienced  Raters  .Non-Experienced  Raters 


21 


Discriminant  Analysis  Behavicral  Measurements 

A discriminant  ana  ysis  was  applied  to  the  measurements  taken  from 
the  subjects  on  the  16;’F  and  the  RPM,  As  in  the  above  analysis,  the 
experienced  rater  - non-experienced  rater  dichotomy  was  used  to  divide 
the  subjects  into  two  (jroups. 

The  score  from  the  16PF  and  the  RPM  were  first  converted  to  standard 
ten  scores,  making  the  range  of  possible  scores  from  1 to  10  on  each  of 
the  ten  measured  dimensions.  Table  8 shows  the  mean  and  standard  deviation 
of  each  group  for  each  dimension. 


TABLE  8 

MEAN  A, ID  STANDARD  DEVIATION  OF 
PERSONALITY-SUPERIOR/SUBORDINATE  MEASUREMENTS 


Mean 

Standard 

Deviation 

Variable 

Rate's 

Non-raters 

Raters 

Non -raters 

1 Authoritarian 

5.547 

5.133 

1.965 

2.325 

2 Equal itari  an 

5.530 

5.533 

1.928 

1.684 

3 Permissive 

5.5?3 

5.466 

1.978 

1.552 

4 Rebel 

5.934 

4.600 

2.009 

2.028 

5 Critic 

5.928 

6.066 

2.234 

1.162 

6 Ingratiator 

5.C23 

5.266 

1.854 

i.624 

7 Extrovert 

4.595 

5.200 

1.848 

1.473 

8 Independent 

5.751 

6.200 

1.511 

1.373 

S Neurotic 

6.156 

5.666 

1.859 

1.676 

10  Poise 

5.833 

5.266 

2.196 

2.374 

A second  discriminant  analysis  was  performed  on  ;he  dcta  tc  test 
the  r.ypothesis  tnat  the  two  groups  were  cifferent  in  thei  ' oersonal ities 
and  their  superior/sutordinate  "o'ie  styles.  The  stei-wise  analysis 
was  usea  and  the  contribution  o"  each  variable  tc  the  aiscriminant 
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analysis  was  computed.  Table  9 shows  the  analysis  of  benavioral 
measures  between  the  tv/o  groups  and  the  test  of  significance  from  the 
computed  F ratio. 


TABLE  9 

SIGNIFICANCE  OF  DISCRIMINABILITY  OF 
PERSONALITY-SUPERIOR/SLBORDINATE  MEASUREMENTS 


Step  # 

Vari able 
Entered 

Resulting 

Value 

Degrees 

of 

Freedom 

Probability 

1 

4 

Rebel 

4.636 

1 

55 

< 

.05 

2 

8 

Independeit 

4.037 

2 

54 

< 

.05 

3 

2 

Equal itari an 

3.055 

3 

53 

< 

.05 

4 

7 

Extrovert 

2.525 

4 

52 

< 

.05 

5 

1 

Author!  ta-'i  an 

2.156 

5 

51 

> 

.05 

6 

10 

Poise 

1.836 

6 

50 

> 

.05 

7 

3 

Permissivj 

1.628 

7 

49 

> 

.05 

8 

9 

Neurotic 

1.399 

8 

48 

> 

.05 

9 

(F 

level  for  entry  of  variables 

5 and 

6 were 

; insuffi 

10  for  further  computations.) 


The  analysis  shows  that  the  two  groups  are  not  significantly  dif- 
ferent from  each  other  in  their  behavioral  measurements  oeyond  the  first 
four  variables  conside''ed.  Only  variable  number  4 (rebel)  added 
significantly  to  the  ciscrimination  (See  Appendix  ^ ).  Ai'r.en  taken  all 
together,  the  variables  do  not  significantly  discrim’jnate  between  the 
two  groups. 


Tne  discriminant  Tunction  generatea  from  this  analysis  is  shown 


I 
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TABLE  10 

DIS3RIMINANT  FUNCTION  OF 
PERSONALITY-SUPERIOR/SUBORDINATE  MEASUREMENTS 


Variable 

Function 

A 

Functi on 
B 

1 

Authoritarian 

5.876 

5.775 

2 

Equal  itari  an 

7.149 

6.806 

3 

Permissive 

1.975 

1.815 

4 

Rebel 

0.915 

0.386 

7 

Extrovert 

8.856 

9.102 

8 

Independent 

6.454 

6.977 

9 

Neuroti c 

13.293 

13.350 

10 

Poise 

1.457 

1.312 

Each  observation  was  classified  into  one  of  the  following 
two  pre-selected  groups  (experienced  raters  or  Non-experienced  raters). 
The  following  two  by  tvo  matrix  (Table  11)  shows  this  classification 
process. 


TABLE  11 

DISCRIMINAFION  MATRIX  OF  PERSONAL ITY- 
SUPERICR/SUBORDINATE  MEASUREMENTS 


Observations 
Classified  into 
Groups 


Pre-selected 

Experienced 

Non-experienced 

Groups 

Raters 

Haters 

j 1 

1 Experienced  I 

30  ! 

i 

! 

■ 2 ! 

1 Raters 

\ 

I 

1 

, Non-Exper'erced 

i 

1 

-i  ' 

; Raters 

-I 

i 
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Canonical  Analysis 

Since  the  discriminant  analysis  indicated  that  the  racing  behavior 
of  experienced  raters  s significantly  different  than  the  rating  behav- 
ior of  non-experienced  raters,  canonical  analysis  was  applied  to  the 
data  to  examine  the  nacure  of  the  difference.  The  subjects  were 
divided  into  two  groups,  experienced  raters  and  non-expe "ienced  raters, 
and  eight  separate  canonical  analysies  were  applied,  using  the  subjects' 
scores  on  the  16PF  and  the  RPM  as  the  predictors  and  their  behavior  in 
the  rating  of  the  writcen  descriptions  ("Ratees")  as  the  criteria.  Table 
12  shows  the  eight  pai'-wise  combinations  used  for  the  canonical  correlations. 

TABLE  12 

PREDIC-'OR-CRITERIA  COMBINATIONS 
USED  -OR  CANONICAL  CORRELATIONS 


PREDICTORS 

Rc  (MeasureiTiant  o ' Rater) 

CRITERIA 

(Characteristics  of  "Ratee") 

Experien 

ced  Rater 

i 

i 

Superior/subordina:e  Role  Style 

' 

Superior/subordir ate  role  style 

2 

Superior/subord1na:e  Role  Sr.ylo 

Personality 

3 

Personality 

Personality 

4 

Personal ity 

I 

Superior/subordinate  Role  Style  ! 

I 

Non-expen  enced  Rater  ! 

5 

Superior/subordine  :e  Role  Style 

Superior/suborainate  Role  Style  j 

5 

Superior/subordina :e  Role  S-.yle 

Personality  j 

7 

Persona'ity 

Personality  ; 

8 

Personal i ty 

S-perior/suDordirav.e  Role  Style  * 
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Of  the  eignt  sets  >f  canonical  correlations  computed,  four  failed 
to  meet  the  requirements  for  significance  at  the  .10  level  as  defined 
by  Bartlett's  lambda  test  (1941).  Tables  13  through  16  show  the 
results  of  the  test  of  significance  for  the  pair-wise  correlations 
that  did  not  satisfy  the  significance  criterion. 
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TABLE  13 

SUPERI0R/SU30RDINATE  MEASUREMENT  OF  EXPERIENCZC 
RATER  CORRE.ATED  WITH  RATINGS  ASSIGNED  TO  SUPERIOR/ 
SUBORDINATE  DESCRIPTIONS  BY  EXPERIENCED  RATERS. 


CANONICAL 

CORRELATION  LAMBDA 


DEGREES 

OF 

CHI-SQUARE  FREEDOM  PROBABILITY 


0.91960 

0.01103 

38.30887 

36 

> .10 

0.86499 

0.07148 

22.42567 

25 

> .10 

0.75778 

0.28389 

10.70280 

16 

> .10 

0.42185 

0.66678 

3.44506 

9 

> .10 

0.37720 

0.81112 

1.77940 

4 

> .10 

0.23310 

0.94567 

0.47486 

1 

' .10 

TABLE  14 


SUPERIOR/ SUBORDINATE  MEASUREMENT  OF  EXPERIENCED 
RATERS  CORRELATED  WITH  RATINGS  ASSIGNED  “3 
PERSONALITY  DESCRI.'^TIONS  3Y  EXPERIENCED  RATERS 


DEGREES 

CANONICAL  OF 

CORRELATION  _ LAMBDA  CHI-S:..^vRE  -REEDOM PR3SAE I-II'Y 

0.38453 
0.76964 
C. 40 747 
C.U1734 

x-JfTcxxxifr  vrxwfx* w/r WA*>  xx’Ax'i‘*A'v  xx  vx'*-Vf'A>'xx*AXX'..***x**xx>.*x  A’xxv  x A-x*-r«rx xx** 


0.07043  25.1G754  24 

0.32391  IC.I'OjSo  15 

0.7945E  2.11-.5C  3 

C.952o7  C. 45 1-71  3 


Lm 


-Jt;- 


I 

1 
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TABLE  15 


SUPERIOR/SUBOi^DINATE  MEASUREMENT  OF  NON-EXPERIENCED 
RATERS  correlated  WITH  RATINGS  ASSIGNED  TO 
PERSONALITY  DESCRIPTIONS  BY  NON-EXPERIENCED  RATERS 


CANONICAL 

CORRELATION 

LAMBDA 

CHI-SQUARE 

DEGREES 

OF 

FREEDOM 

PROBABILITY 

0.58941 

0.45105 

29.06032 

24 

> .10 

0.49189 

0.69116 

13.48254 

15 

> .1C 

0.28792 

0.91177 

3.37142 

8 

> ,1G 

0.07623 

0.99419 

0.21273 

3 

> .1C 

★★**★***★****★★***★***+*********★*******★******************★***★★ 


TABLE  16 

PERSONALITY  MEASUREMENTS  OF  NON-EXPERIENCED  RATERS 
CORRELATED  WITH  RATINGS  ASSIGNED  TO  SUPERIOR/SUBORDINATE 
DESCRIPTIONS  BY  NON-EXPERIENCED  RATERS. 


CANONICAL 

CORRELATION 


DEGREES 

OF 

LAMBDA  CHI-SQUARE  FREEDOM  PROBABILITY 


0.62514 

0.45866 

28.45006 

24 

> .10 

0.44143 

0.75136 

10.43410 

15 

> .10 

0.24712 

0.93321 

2.52308 

8 

> .10 

0.07805 

0.99391 

0.22305 

3 

> .10 

The  remaining  four  sets  of  canonical  correlations  produced  two 
maximum  correlations  tnat  were  significant  at  the  .13  level  and  two 
that  were  significant  at  tne  .05  level.  Tables  17  througn  20  show  the 
results  of  she  test  of  signifi car.ca  for  those  correlations  that  produced 
maximum  canonical  correlations  wrier,  cio  meet  the  s'.gr.i f' cance  criter'ion , 
and  lisplay  the  canonical  coeffi  :1er.ts  a.'.at  inoicate  wr.icr,  variaoles  con- 
tributed to  the  corre  ation. 
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TABLE  17 


superior/subord:nate  measurements  of  experienced  raters 

CORRELATED  WITH  RATINGS  ASSIGNED  TO  PERSONALITY  DESCRIPTIONS 
BY  NON-EXPERIENCED  RATERS. 


CANONICAL 

CORRELATION  LAMBDA  CHI-SQUARE 


DEGREES 

Of 

FREEDOM 


PROBABILITY 


0.97363 

0.01979 

37.26547 

24 

< .05 

0.69167 

0.38016 

9.18815 

15 

> .10 

0.38766 

0.72884 

3.00489 

8 

> .10 

0.37718 

0.85773 

1.45787 

3 

> .10 

TABLE  17a 


COEFFICIENTS  FOR  MAXIMUM  CANONICAL  CORRELATION  0.97353 


LEFT  HAND  VARIABLES 

1.  Authoritarian 

2.  Equal itari an 

3.  Permissive 

4.  Rebel 

5.  Critic 

6.  Ingratiator 


:OEFFICIENTS  RIGHT  HAND  VARIABLES  COEFFICIENTS 


-0.54399 

1. 

Extrovert 

0.76686 

0.09186 

2. 

Independent 

-0.52357 

0.02849 

3. 

Neuroti c 

0.36266 

0.88398 

1 

4. 

Poise 

0.07926 

0.39019 

0.59929 


kieieicieirk'kic'>cic'Jei(^icieieicirk'k’k'kirkie’kieiric-)<i('fr'Kic*ieie'kieiri('kirkieici(i(irk  ★★ 


I 

1 
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TABLE  18 


SUPERIOR/SUBORDiNATE  MEASUREMENTS  OF  NON-EXPERIENCED  RATERS 
CORRELATED  WITH  RATINGS  ASSIGNED  TO  SUPERIOR/SUBORDINATE 
DESCRIPTIONS  BY  NON-EXPERIENCED  RATERS 


DEGREES 

CANONICAL  OF 


CORRELATION 

LAMBA 

CHI-SQUARE 

FREEDOM 

PROBABILITY 

0.63910 

0.23519 

51.38196 

36 

< 

.05 

0.58277 

0.39757 

32.74438 

25 

> 

.10 

0.53389 

0.60204 

18.01408 

16 

> 

.10 

0.37625 

0.84205 

6.10284 

9 

> 

.10 

0.12441 

0.98091 

0.68409 

4 

> 

.10 

0.06054 

0.99633 

0.13036 

1 

> 

.10 

•k*'kirie’irkirieifieieitirk  k'k  'k'k'k'k'k‘x1t1rirkitieic1tii:'k’kieiticicieicirk'kirkirk'kieirkirk'kirk'kirkicicie'k'kiK 

TABLE  18a 

COEFFICIENTS  FOR  MAXIMUM  CANONICAL  CORRELATION  0.63910 


LEFT  HAND  VARIABLES  COEFFICIENTS  RAND  HAND  VARIABLES  COEFFICIENTS 


1.  Authoritarian 

-0.08654 

1.  Authoritari  ai 

0.68239 

2.  Equal itari an 

-1.09058 

2.  Equal itari an 

0.28363 

3.  Permissive 

-0.30437 

3.  Permissive 

-0.26250 

4.  Rebel 

0.11400 

4.  Rebel 

-0.18610 

5.  Critic 

0.07736 

5.  Critic 

0.52585 

6.  Ingratiator 

0.37306 

6.  Ingratiator 

0.27171 

iciricitit'kiticicirieieieicitititicitieieie-Jieiriritieiriririei^'itiricieirififirkiC'kieicirteic’kic'k'k'Kie'k'kic'k'k'k'kie'kirk'kieif’k-ic'k  ★★  ★★★ 


TABLE  19 


PERSONALITY  ME.ASUREMENTS  OF  EXPERIENCED  RATERS 
CORRELATED  WITH  RATINGS  ASSIGNED  TO  PERSONALITY 
DESCRIPTIONS  B''  EXPERIENCED  RATERS. 


DEGREES 


CANONICAL 

CORRELATION 

LAMBDA 

CHI -SQUARE 

OF 

FREEDOM 

PROBABILITY 

0.85638 

0.14741 

20.10281 

16 

< .10 

0.62823 

0.55287 

6.22256 

9 

> .10 

0.04563 

0.91336 

0.95159 

4 

> .10 

0.04297 

0.95703 

0.46118 

1 

> .10 

********************** vrt  ******************************************* 


TABLE  19a 

COEFFICIENTS  FOR  WaXIMUM  CANONICAL  CORRELATION  0.856SS 
LEFT  HAND  VARIABLES  COEFFICIENTS  RIGHT  HAND  VARIABLES  COEFFICIENTS 


Extrovert 

0.52948 

— 

1. 

Extrovert 

-0.12489 

2. 

Independent 

0.46355 

2. 

Independent 

0.48250 

3. 

Neurtoic 

0.46242 

3. 

Neurotic 

-0.24992 

4. 

Poise 

0.04501 

4. 

Poise 

0.83014 

**********************  r***<r********V******************-*r*  Jf******************** 
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TABLE  20 


PERSONALITY  ilEASUREMENTS  OF  NON-EXPERIENCED  RATERS 
CORRELATED  WITH  RATINGS  ASSIGNED  TO  PERSONALIT'' 
DESCRIPTIONS  BY  NON-EXPERIENCE  RATERS. 


DEGREES 


CANONICAL 

CORRELATION 

LAMBDA 

CHI-SQUARE 

OF 

FREEDOM 

probab:lity 

0.61751 

0.50327 

25.74866 

16 

O 

V 

0.36938 

0.81346 

7.74236 

9 

> .10 

0.22946 

0.94198 

2.24138 

4 

> .10 

0.07526 

0.99434 

0.21300 

1 

> .10 

************* *********-f***************************************** 


TABLE  20a 

COEFFICIENTS  FOR  MAXIMUM  CANONICAL  CORRELATION  C. 61751 


LEFT  HAND  VARIABLES  COEFFICIENTS  RIGHT  HAND  VARIAB.ES  COEFFICIENTS 


1. 

Extrovert 

-0.88666  ! 
1 

1 

X • 

Extrovert 

1 

0.01933 

1 

1 

2. 

Independent 

1 

0.60176  i 
i 

2. 

Independent 

1 -0.80778 

1 
1 

3. 

Neuroti c 

-0.81891 

^ • 

Neuroti c 

: -0.03691 

4. 

Poise 

-1.20361 

i 

4. 

Poise 

! 0.58802 

) 

1 

1 

********************!**  **********x*** *************************************** 
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Factor  Analysis 

Factor  analysis  wis  appliec  to  the  data  to  generate  constructs 
wnich  help  explain  the  rating  behavior  of  the  two  groups.  The  person- 
al ity-superi  or/subordi  late  scores  and  the  ratings  assigned  to  descriptions 
of  personal ity-superio "/subordinate  characteristics  were  factored  for 
each  group  using  an  orshogonal  varimax  rotated  factor  analysis  process. 
Table  21  shows  the  fivi  factors  generated  by  this  process  for  the  non-rater 
group,  and  the  loading  of  each  variable  in  each  factor. 


TABLE  21 

RATING  BEHWIOR  FACTORS  FOR  NON-RATERS 


Measurement 

Variable 

1 

i^aCYors 

2 3 

4 

5 

1. 

Authoritarian 

0.548 

-0.098 

-0.011 

0.224 

0.404 

2. 

Equal itari an 

-0.743 

-0.299 

-0.011 

0.044 

-0.002 

3. 

Permissive 

0.200 

0.389 

0.478 

0.375 

-0.287 

4. 

Rebel 

0.307 

-0.001 

-0.731 

-0.103 

0.031 

5. 

Criti  c 

0.239 

-0.249 

0.370 

0.644 

0.009 

6. 

Ingratiator 

0.165 

-0.035 

0.761 

O.IX 

0.102 

7. 

Extrovert 

-0.152 

-0.779 

0.108 

-0.04^ 

-0.146 

8. 

Independent 

0.078 

-0.403 

-0.679 

0.258 

0.102 

9. 

Neurotic 

0.147 

0.834 

0.199 

-0.074 

-0.126 

10. 

Poise 

0.351 

-0.549 

-0.449 

0.033 

-0.104 

Rating  Behavior 

1 

Variable 

1 

1 

11. 

Authorita, ian 

-0.003 

0.005 

0.193 

-0 . 152 

0.783 

12. 

Equalitarian 

0.671 

-0.130 

0.058 

-o.3o: 

-0.326 

13. 

Permissive 

0.553 

-0.137 

0.173 

-0.157 

0.301 

14. 

Rebel 

-0.029 

0.401 

-0.123 

0.098 

0.578 

15. 

Cri  ti  c 

0.714 

0.057 

-0.143 

-0.321 

0.133  i 

16. 

Ingratiator 

0.289 

90.074 

0.007 

-0.675 

0.240  1 

17. 

Extrovert 

0.132 

-0.027 

0.114 

-o.ir 

-0.118  } 

18. 

Independent 

0.414 

-0.113 

-0.070 

O.Cl- 

0.569 

19. 

Neurotic 

0.442 

-0.076 

0.524 

-0.252 

0.298  ! 

20. 

Poise 

0.602 

0.205 

-0.038 

0.148 

0.009  1 

L 


The  rating  behavior  factors  generatea  -'or  the  non-rc.ter  group 
and  the  loadings  of  each  variable  in  each  factor  are  shown  in  Table  22. 


TABLE  22 

RATING  BEHAVIOR  FACTORS  FOR  EXPERIENCED  RATERS 


Measurement 

Variable 

1 

2 

FACTORS 

3 

4 

5 

1. 

Authori tari an 

0.121 

0.799 

0.168 

0.351 

-0.083 

2. 

Equalitarian 

-0.026 

-0.276 

-0.457 

-0.714 

0.230 

3. 

Pemiissive 

-0.164 

0.772 

0.256 

-0.229 

-0.147 

4. 

Rebel 

0.098 

-0.304 

0.013 

0.712 

-0.557 

5. 

Critic 

-0.032 

-0.258 

0.113 

0.062 

0.852 

6. 

Ingratiator 

0.072 

0.033 

0.505 

-0.333 

0.660 

7. 

Extrovert 

0.035 

-0.224 

-0.761 

0.020 

-0.205 

8. 

Independent 

0.103 

-0.581 

-0.388 

-0.247 

-0.308 

9. 

Neuroti c 

-0.088 

-0.041 

0.915 

0.261 

0.111 

10. 

Poi  se 

0.222 

0.027 

-0.741 

0.361 

0.043 

Rating  Behavior 

Variables 

11. 

Authoritarian 

0.745 

-0.492 

0.147 

-0.048 

0.121 

12. 

Equal i tari an 

0.434 

0.601 

-0.190 

-0.182 

-0.218 

13. 

Permissive 

0.852 

0.149 

-0.299 

-0.175 

-0.101 

14. 

Rebel 

0.180 

-0.922 

-0.031 

0.039 

-0.098 

15. 

Criti  c 

0.375 

0.702 

-0.282 

-0.202 

-0.112 

16. 

Ingratiator 

0.614 

-0.058 

-0.484 

0.101 

0.132 

17. 

Extrovert 

0.643 

0.463 

0.214 

0.220 

-0.287 

18. 

Indepenaent 

0.696 

-0.232 

0.256 

-0.227 

-0.502 

19. 

Neurotic 

0.908 

0.088 

-0.227 

0.223 

0.087 

20. 

Poise 

0.050 

1- 

0.066 

0.236 

-0.745 

-0.181 
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CHAPTER  IV 

SUMMARY  AND  CONCLUSIONS 

Previous  research  has  shown  that  bias  exists  in  performance  eval- 
uation. The  postulation  that  the  source  of  this  bias  is  similarities 
in  demographic  characteristics  of  the  rater  and  ratee  has  not  been 
substantiated.  The  present  study  has  made  an  attempt  to  examine 
similarities  or  differences  in  personalities  and  superior/subordinate 
role  styles  of  raters  and  ratees  as  a possible  source  of  bias.  Specifically, 
the  study  sought  to  establish  whether  the  rating  behavior  of  experienced 
raters  is  significantly  different  from  that  of  non-raters,  and  if  such 
similarities  or  differences  could  be  interpreted  as  a source  of  rater  bias. 

Procedures 

To  accomplish  the  described  purpose,  measurements  were  taken  of  the 
personalities  and  superior/subordinate  role  styles  of  fifty-seven  subjects 
using  the  16PF  and  the  RPM.  The  subjects  also  evaluated  the  "performance" 
of  ten  hypothetical  "ratees".  The  ratees  were  written  descriptions  of 
the  personality  factors  and  the  superior/subordinate  role  styles  upon 
which  the  subjects  were  measured.  An  examination  was  made  of  the  relation- 
snip  of  the  measurements  taken  of  the  subjects  and  their  behavior  in 
rating  the  written  description  of  these  measurements. 

Conclusions 

An  interpretation  of  the  computed  results  produced  the  following 


conclusions. 
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i 

I 1.  The  rating  behavior  of  experienced  raters  appears  to  be 

^ significantly  different  from  the  rating  behavior  of  non-raters.  The 

I 

discriminant  analysis  applied  to  the  data  indicates  that  significant 
discrimination  can  be  made  between  the  two  groups  on  the  basis  of 
rating  behavior.  A computed  F value  for  the  ten  variables  as  a group 
was  significant  at  .05  level.  (F  = 2.634,  df  9 47,  <.05)  The  discrim- 
inant function  indicates  that  experienced  raters  exhibit  a rating 
behavior  most  differen':  from  the  behavior  of  non-raters  \'jhen  rating 
critics.  The  non-rate.',  who  is  by  definition  a subordinate  to  the 
experienced  rater,  does  not  attach  the  value  to  the  characteristics 
of  the  critic  that  the  experienced  rater  does.  In  seven  cf  the  ten 
variables  considered,  the  experiet  ced  rater  appears  to  be  introducing 
more  bias  into  the  rating  process  than  the  non-rater.  T.nat  the  two 
groups  are  different  ii  supported  by  the  discrimination  matrix;  74" 
of  the  experienced  raters  meet  the  criteria  for  inclusion  into  the 
"Experienced  Rater"  group  and  80%  of  the  non-raters  are  classified 
. into  the  "Non-rater"  group, 

r 2.  The  personalities  and  the  superior/subordinate  role  styles  of 

' , tie  experienced  raters  are  not  significantly  different  from  the  person- 

alities and  the  superior/subord'nate  role  styles  of  the  non-raters.  Dis- 
criminant analysis  incicates  that  no  significant  discriri.-.ation  can  be 
made  between  experienced  raters  and  non-ramers  on  the  bas'. s of  the  per- 
sonalities and  the  supari or/subordinate  role  styles  cf  ;ni_  two  groups. 

.nen  all  ten  variable^  are  co.nsicerec,  c.ne.'e  is  no  s’.gr.'.f-. cance  zo  the 
ciscriminabirity  between  the  two  groups,  a per-variable  analysis  indicates 
tnat  Giscriminabi lity  exists  up  to  ana  including  tie  fCcrth  variable  in 
the  step-wise  p'ogros; ‘.on.  Tne  discriminant  function  s'Cvs  that  the  non-raters 
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scored  higher  on  the  rjbel  and  the  equal itarian  scales  wi'.le  the 
experienced  raters  scored  higher  on  the  extrovert  and  the  independent 
scales.  The  discrimination  matrix  shows  slightly  less  support 
for  discrimination  between  the  two  groups  on  their  personality  factors 
and  their  superior/subordinate  role  styles.  Only  71%  of  the  experienced 
raters  meet  the  criteria  for  inclusion  into  the  "Experienced  Rater" 
group  and  only  73%  of  the  non-raters  are  classified  into  the  "Non-rater" 
group.  This  information,  along  with  the  computed  F value,  indicates 
that  the  two  groups  are  different,  but  not  significantly  so. 

3.  Experienced  raters  introduce  bias  into  the  rating  process  as  a 
function  of  the  relationship  of  their  superior/subordinate  role  styles 
and  their  personalities  to  the  personalities  of  the  ratee. 

Two  of  the  four  significant  canonical  correlations  show  the  bias  of 
the  experienced  rater.  The  superior/subordinate  role  style  of  the 
experienced  rater  correlates  significantly  with  the  personality  factors 
of  the  ratee  at  the  .05  level  (Table  17).  The  coefficients  for  this 
correlation  (Table  17a)  shows  a strong  subordinate  orientation  on  the 
part  of  the  rater.  All  three  subordinate  role  styles  have  a coefficient 
larger  than  the  arbit  rarily  assigned  "significance"  level  of  .350.  Tne 
only  superior  role  styles  in  excess  of  .350  is  the  authoritarian  which 
is  negative.  An  interpretation  of  these  coefficients  might  be  that  the 
experienced  rater  who  perceives  himself  to  be  a suborair.ace  tends  to  make 
his  performance  evaluations  on  the  oasis  of  personality  factors.  The  bias 
introduced  is  in  favor  of  the  extrovert  (.767)  and  agairsc  the  independent 
(-.524)  and  the  neurotic  (-.363). 

The  personality  factors  of  tne  experienced  rater  ccr.'elates  significantly 
with  the  personality  -actors  o-^  the  racec  at  tne  .10  le.el  (Table  19).  The 


tonaermindedness  and  i itroversicn  as  being  tne  resul":  of  ris 
independence. 
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Discussion  of  Factor  Analysis 

A factor  analysis  was  applied  to  the  scores  and  rating  behavior 
of  the  experienced  raters  and  the  non-experienced  raters  to  generate 
constructs  which  help  explain  rating  behavior  as  it  relaces  to  the 
personality  and  superior/subordinate  role  styles  of  the  "ater.  Five 
factors  were  extracted  for  each  group.  Factor  loadings  of  .350  or 
more  were  considered  significant.  In  the  following  discussion,  the 
scores  of  the  rater  are  referred  to  as  the  "rater"  and  the  rating 
behavior  as  the  "ratee‘. 

Factors  for  Noh-Experienced  Raters 

Factor  #1  consist.,  of  a tocgh-minded  authoritarian  who  is  not 
equalitarian  favoring  :he  critic-equalitarian  toughminded  ratee.  There 
is  also  a tendency  to  'avor  the  permissive-neurtoic-inoepenoent  ratee. 
It  appears  that  this  factor  describes  tr.e  authoritarian  -ater  who  is 
somewhat  defensive  and  therefor  feels  that  the  personal i ;y  types  anc 
superior/subordinate  role  styles  he  favors  are  the  least  'cr.reatening. 
This  facoor  might  oe  cermed  the  "Defensive  Authoritarian  Rater". 

Factor  #2  shows  a neurotic  introvert  rater  wno  : s tur.aerminded  arc 
cependent.  This  rater  tends  to  oe  permissive  in  his  sup'.ir-.or  capacity 
and  favors  the  rebel  suboroinatt.  This  factor  seems  to  describe  tne 
under-con fi cent  rater  yho  admires  the  rebel.  The  rater  .nay  achieve 
some  vicarious  satisfaction  from  watching  the  reoel.  The  factor  might 
be  laclec  the  "Frustracec  Rater". 

Factor  y3  Involve-  an  ingraciaaors  rcr.-rebel , critic  who  is 
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permissive.  The  rater  is  also  dependent  and  tendermindec  and  favors 
the  neurotic  ratee.  This  factor  seems  to  reflect  a rater  who  is 
under  confident  but  whc  Is  resigned  to  his  state.  He  favors  the 
neurotic  from  a position  of  empathy.  This  factor  might  te  called 
the  "Frustrated  but  Resigned  Rater". 

Factor  #4  consists  of  a critic  rater  who  favors  an  introvert, 
non-ingratiator  ratee.  This  interaction  might  be  interpreted  as  the 
critic  assigning  valve  to  people  who  do  not  socialize  on  tne  job  and 
stick  to  the  business  at  hand.  Previous  research  (Sweney  and  Season, 
1971)  shows  this  to  be  a characteristic  of  the  critic.  Lxtroversion 
and  ingratiation  both  rely  on  interpersonal  interaction  and  the 
critic  seems  to  seek  to  avoid  non-productive  interpersonal  interaction. 

Factor  #5  shows  a toughminded  authoritarian  ratee  who  favors  the 
rebel,  independent  ratee.  This  construct  might  be  explained  as  the 
self-confident  rater  wno  seeks  interaction  with  his  suboroinates. 

The  rebel -independent  ,'atee  will  provide  this  interaction.  The  self- 
confidence  of  the  rater  makes  this  interaction  a challenge.  This 
factor  might  be  called  the  "Self-confident  Authoritarian  Rater". 

Factors  for  Experience j Raters 

Factor  #1  lists  all  but  two  of  the  ratee  characaerisr: cs.  The 
two  characteristics  ommitted  are  the  rebel  and  the  tou9h;,v.nQed  (poise). 
This  appears  to  be  a generalized  ratee  factor.  There  are  no  significant 
loadings  from  the  rater  characteristics. 

Factor  #2  consists  of  an  authoritar: an  permissive  racer  wno  is 
cependent  and  who  fevers  tne  faCee  who  is  a non-critic  r,i,ratiater  ana 
a non-autno''i‘.arian  permissive.  The  racer  also  favors  ^ ratee  wno  is  an 
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extrovert.  This  factor  seems  to  describe  a manipulative  rater  who 
is  somewhat  inclined  to  favor  ratees  who  are  more  easily  manipulated. 
He  rejects  the  critic  and  authoritarian  ratee  because  these  role  styles 
do  not  lend  themselves  to  manipulation.  This  factor  may  be  labeled 
the ‘Manipulative  Rater". 

Factor  #3  describes  a rater  who  is  a neurotic  tenderminded 
introvert  and  somewhat  dependent.  This  rater  is  also  and  ingratiator 
and  not  permissive.  He  rejects  the  ingi'atiator  ratee,  possibly  because 
he  sees  ingratiation  as  his  own  least  desirable  characteristics.  He 
may  perceive  that  his  own  ingratiation  as  necessary,  but  feels  that  it 
is  not  desirable.  This  factor  can  be  identified  as  the  "Reaction  to 
Ingratiation"  factor. 

Factor  #4  shows  a toughminded  authoritarian  rebel  who  is  not 
permissive  favoring  a tenderminded  ratee.  One  explanation  for  this 
factor  might  be  that  the  rater  is  "protecting"  the  tenderminded  ratee. 
This  factor  might  be  called  the  "Paternalistic  Authoritarian"  factor. 

Factor  #5  consists  of  the  critic-ingratiator  rater  who  is  not  a 
rebel  and  who  favors  the  dependent  ratee.  The  critic-ingratiator  may 
perceive  himself  to  be  dependent  and  thus  favors  the  dependent  from  a 
position  of  empathy. 

No  conclusions  are  drawn  from  the  factors  presentee  above,  they 
only  help  show  some  of  the  complexity  of  the  rating  process.  It  is 
possible  to  point  out  that  there  appears  to  be  appreciably  more  predict- 
ability associated  with  the  factor  generated  from  the  non-experienced 
raters  than  from  the  experienced  raters.  This  indicates  tnat  with 
experience  she  rating  process  becomes  more  complex,  and  perhaps  more 
''contaminated''. 
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Limi tatlons  of  the  Study 

In  an  attempt  to  provide  "pure  types"  as  ratees  and  to  eliminate 
extraneous  variables  from  the  study,  a certain  amount  of  artificialality 
was  introduced  into  the  study.  This  was,  however,  a trade-off  that  the 
author  chose  to  make. 

In  a previous  study  (Season, 1972)  the  experienced  rater-non-exper- 
ienced  rater  dychotomy  was  not  used  and  no  significant  correlation  was 
found  between  the  characteristics  of  the  ratee  and  the  measurements  of 
the  rater.  The  present  study  shows  that  the  behavior  of  the  two  groups 
is  distinstly  different.  Some  of  the  bias  in  the  rating  process  has 
been  shown  to  be  a function  of  the  relationship  of  the  superior/subord- 
irate  role  styles  and  the  personality  factors  of  the  raters  and  the 
same  dimensions  of  the  ratees. 

Future  studies  of  bias  as  a function  of  superior/subordinate  role 
styles  and  personalities  might  concern  themselves  with  obtaining  a larg- 
er sample  size.  A series  of  ratings  might  be  performed  by  the  subjects 
instead  of  one  isolated  rating  task.  An  analysis  of  the  conduct  of  this 
study  leads  to  the  hypothesis  that  the  use  of  a series  of  rating  tasks 
would  be  more  beneficial  since  there  would  be  more  of  a tendency  for  be- 
havioral patterns  to  develope  as  a result  of  rating  the  same  ratee  sev- 
eral times. 
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PER.-ORMANCE  EVALUATION  IiNOEX 

This  instrument  is  designed  to  allow  you  to  evaluate  the  perform- 
ance of  ten  individuals,  based  upon  a verbal  description  of  e=».ch.  The 
object  of  this  exercise  is  for  you  to  try  to  give  the  most  favorable 
rating  to  the  individual  that  you  would  like  to  see  promoted  to  the 
next  rank.  Only  one  of  the  ten  can  be  promoted.  The  promotion  will 
be  from  E-4  to  E-5. 

The  ratees  are  presumed  to  be  equal  in  all  respects  concerning  pro- 
motability  (time  in  grade,  time  in  service,  test  scores,  etc.)  Since 
the  ratees  are  alike  in  these  aspects  of  promotability , you  are  asked  to 
treat  the  verbal  descriptions  as  notes  you  have  taken  from  interviews  with 
each  of  them  and  from  observation  of  each  of  them.  On  tie  basis  of 
these  notes  you  are  to  rate  each  of  the  men  on  a scale  of  1 to  10  on 
five  items. 

EXAMPLE 

***Airman  "A"  makes  friends  easily  and  does  not  seeri  to  mind  hard 
work.  He  is  usually  happy  and  energetic.  He  spends  most  of  his  time, 
when  off  duty,  by  himself.  He  does  not  like  people  who  complain  too  much.*** 


1. )  Leadership  potential 

2. )  Ability  to  follow  orders. 

3. )  Ability  to  hold  respect  of  his  men. 

4. )  Communication  effectiveness. 

5. )  Attitude,  miliw.ry  bearing. 
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DESCRIPTION 
OF  RATEE* 


Airman  "A"  knows  what  is  best  for  other  people.  He  often  trys  to 
force  others  to  do  things  his  way.  He  expects  others  to  reject  his 
ideas,  but  insists  that  his  ideas  are  right.  He  looks  for  the  person 
to  blame  when  things  go  w-ong.  He  knows  that  people  won't  work  if  he 
doesn't  keep  an  eye  on  them.  He  seldom  praises  any  of  his  co-workers. 

***  Rate  the  above  Airman  on  the  following  scale.  A rating 
of  1 (one)  indicai:es  very  poor  and  a rating  of  10  (ten)  indicates 
excellent.  Make  your  rating  by  placing  an  X in  the  appropriate 
box  after  each  of  the  five  areas  to  be  rated.*** 


1. )  Leadership  potential . 

2. )  Ability  to  follow  orders. 

3. )  Ability  to  hold  respect  of  his  men. 

4. )  Cotimuni cation  effectiveness. 

5. )  Attitude,  military  bearing. 
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DESCRIPTION 
OF  RATEE* 

Airman  "B"  is  sober  and  serious.  He  exercises  caution  when  making 
decisions.  Problems  cause  him  to  become  tense  and  frustrated.  He  is 
emotional  and  easily  upset.  He  is  sensitive  to  criticism,  but  expects  to 
be  criticized.  He  is  humble  and  timid  towards  his  co-workers  and  his 
bosses. 

****  Rate  the  above  Airman  on  the  following  scale.  A rating 
of  1 (one)  indicates  very  poor  and  a rating  of  10  (;en)  indicates 
excellent.  Make  your  rating  by  placing  an  X in  the  appropriate 
box  after  each  of  the  five  areas  to  be  rated.  **** 
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’'(Neurotic) 


DESCRIPTION 
OF  RATEE* 


Airman  "C  expects  to  be  told  "no"  and  gives  in  when  he  is  told. 

He  is  kind  to  others  and  expects  them  to  repay  his  kindness  with  loyalty. 
When  things  go  wrong,  he  accepts  the  blame.  He  trys  to  :alk  people  into 
doing  what  he  wants  to  do.  He  trys  to  get  along  with  everyone. 

****  Rate  the  above  Airman  on  the  following  scale.  A rating 
of  1 (one)  indicates  very  poor  and  a rating  of  10  (ten)  indicates 
excellent.  Make  your  rating  by  placing  an  X in  the  appropriate 
box  after  each  of  the  five  areas  to  be  rated.  **** 
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1)  Leadership  potential. 

2)  Ability  to  follow  orders. 

3)  Ability  to  hold  respect  of  his  men. 

4)  Communication  effectiveness. 

5)  Attitude,  Military  bearing. 
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DESCRIPTION 
OF  RATEE* 

Airman  "D"  is  very  self-reliant  and  is  realistic  in  his  approach 
to  his  work.  He  refrains  from  participating  in  any  form  of  "non-sense". 

He  takes  situations  as  they  arise  and  analyses  them  crit-cally.  Although 
he  is  enthusiastic,  he  is  very  stubborn  when  he  thinks  he  is  right. 

He  frequently  has  new  -ideas  that  are  well  thought  out.  I 

i 

****  Rate  the  above  Airman  on  the  following  scale.  A rating  | 

of  1 (one)  indicates  very  poor  and  a rating  of  10  (ten)  indicates  I 

J 

excellent.  Make  your  rating  by  placing  an  X in  the  appropriate  | 

i 

box  after  each  of  the  five  areas  to  be  rated.  ****  j 

] 
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DESCRIPTION 


OF  RATEE* 

Airman  "E"  really  accepts  some  of  his  co-workers,  but  he  treats 
all  of  them  as  if  he  thinks  they  know  what  they  are  doing.  When  a 
problem  arises,  he  directs  his  energies  at  finding  a solution.  He 
expects  some  good  ideas  from  others  and  some  not-so-good  ideas.  He 
works  with  people,  sharing  both  the  decisions,  and  the  responsibility 
for  the  out-come. 

*****  Rate  the  Ai.Tnan  on  the  following  scale.  A raping 
of  1 (one)  indicates  very  poor  and  a rating  of  10  ( ;en)  indicates 
excellent.  Make  your  rating  by  placing  an  X in  the  appropriate 
box  after  each  of  the  five  areas  to  be  rated.  **’*’' 


1)  Leadership  potential 

2)  Ability  to  follow  orders 

3)  Ability  to  hold  respect  of  his  men 

4)  Communication  effectiveness 

5)  Attitude,  Military  bearing 
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DESCRIPTION 
OF  RATEE* 


Airman  "F"  frequently  finds  fault  with  his  job,  his  boss,  his 
working  conditions,  etc.  He  seldom  agrees  with  anyone,  he  prefers 
his  own  ideas.  He  thinks  that  people  are  greedy  and  that  they  cause 
problems.  He  makes  little  effort  to  get  along  with  people.  He 
expects  people  to  agree  with  him,  but  he  will  not  compranise  his  ideas. 
****  Rate  the  above  Airman  on  the  following  scale.  A rating 
of  1 (one)  indicates  very  poor  and  a rating  of  10  (ten)  indicates 
excellent.  Make  your  rating  by  placing  an  X in  the  appropriate 
box  after  each  of  the  five  areas  to  be  rated.**** 


1)  Leadership  potential 

2)  Ability  to  follow  orders 

3)  Ability  to  hold  respect  of  his  men 

4)  Communication  effectiveness 

5)  Attitude,  Military  bearing 
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DESCRIPTION 


OF  RATEE* 

Airman  "G"  is  a lively,  happy-go-lucky  person.  He  says  what  he 
thinks  and  makes  friends  easily.  He  is  very  enthusiastic  about  every- 
thing. He  clings  to  his  group  and  stubbornly  asserts  the  ideas  of 
the  group.  He  is  willing  to  participate  in  any  current  activity  that 
others  enjoy. 

****  Rate  the  above  Airman  on  the  following  scale.  A rating 
of  1 (one)  indicates  very  poor  and  a rating  of  10  (ten)  indicates 
excellent.  Make  your  rating  by  placing  an  X in  the  appropriate 
box  after  each  of  the  five  areas  to  be  rated.  **** 
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DESCRIPTION 
OF  RATEE* 


Airman  "H"  is  honestly  critical  of  others;  he  "tells  it  like  it  is". 
He  does  not  expect  either  agreement  or  disagreement  with  his  ideas,  he 
wants  to  have  them  seriously  considered.  In  a problem  stuation,  he 
directs  his  efforts  towards  finding  a solution.  He  thinks  he  might  be 
rewarded  if  he  makes  some  real  contribution.  He  thinks  some  of  his 
co-workers  are  good  mer.  and  some  are  not. 

****  Rate  the  above  Airman  on  the  following  scale.  A rating 
of  1 (one)  indicates  very  poor  and  a rating  of  10  (:en)  indicates 
excellent.  Make  your  rating  by  placing  an  X in  the  appropriate 
box  after  each  of  the  five  areas  to  be  rated.  **** 
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DESCRIPTION 
OF  RATEE* 


Airman  "I"  is  aggressive  and  competetive  in  his  relations  with  his 
co-workers.  He  is  reserved  and  often  critical  of  others.  He  is  imagin- 
ative and  stubborn  about  his  own  ideas.  He  often  experiments,  looking 
for  a better  way  to  do  things.  He  is  self-sufficient  and  resourceful, 
but  is  often  wrapped  up  in  inner-urgencies  to  the  point  that  he  disregards 
the  rules. 

*****  Rate  the  Airman  on  the  following  scale.  A rating 
of  l(one)  indicates  very  poor  and  a rating  of  10  (ten)  indicates 
excellent.  Make  your  rating  by  placing  an  X in  the  appropriate 
box  after  each  of  the  five  areas  to  be  rated.  **** 


1)  Leadership  potential. 

2)  Ability  to  follow  orders. 

3)  Ability  to  hold  respect  of  his  men. 

4)  Communication  effectiveness. 

5)  Attitude,  Military  bearing. 
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DESCRIPTION 
OF  RATEE* 

Airman  "J"  trys  hard  to  please  other  people.  He  is  willing  to 
accept  others  ideas  over  his  own.  He  does  not  mind  being  told  that  he 
is  wrong.  He  often  blames  himself  for  problems  that  arise.  He  feels 
that  others  should  not  be  blamed  for  problems.  He  trys  nard  to  be 
friendly  with  everyone. 

*****  Rate  the  above  Airman  on  the  following  scale.  A rating 
of  1 (one)  indicates  very  poor  and  a rating  of  10  (ten)  indicates 
excellent.  Make  your  rating  by  placing  an  X in  the  appropriate 
box  after  each  of  the  five  areas  to  be  rated.  **** 
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CONTRIBUTION  OF  INDIVIDUAL  VARIABLES 


Behavioral  Measurements 


Variable 

Included 

F 

Value 

Degrees 

of 

Freedom 

Probability 

4, 

Rebel 

4.6362 

1 

55 

> 

.05 

8. 

Independent 

3.2475 

1 

54 

< 

.05 

3. 

Equal itarian 

1.0794 

1 

53 

< 

.05 

7. 

Extrovert 

3.9439 

1 

52 

< 

.05 

1. 

Authoritarian 

3.7350 

1 

51 

< 

.05 

10. 

Poise 

3.3720 

1 

50 

< 

.05 

3. 

Permissive 

3.4909 

1 

49 

< 

.05 

9. 

Neuroti c 

3.0249 

1 

48 

< 

.05 

Vari able 
Included 

F 

Value 

Degrees 

of 

Freedom 

Probab i 7 i ty 

5. 

Cri ti c 

4.5417 

1 

55 

> 

.05 

9. 

Neurotic 

3.5991 

1 

54 

< 

• uO 

i.. 

Authoritarian 

5.1590 

1 

53 

> 

.05 

8. 

Independent 

3.3281 

1 

52 

< 

.05 

6. 

Ingratiator 

1.7795 

1 

51 

< 

.05 

4. 

Rebel 

1.7999 

1 

50 

< 

.05 

3. 

Permiss'.  ve 

1.8203 

1 

49 

< 

.05 

7. 

Extrovert 

3.1158 

1 

48 

< 

.05 

2. 

Equal  i tari  an 

3.0502 

1 

47 

< 

AT 

I 


